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(54) Phase recovery with blind equalisation for dual mode CAP, QAM receivers 



(57) A dual-mode receiver uses a hybrid cost func- 
tion that provides for automatic constellation phase re- 
covery regardless of whether a CAP signal or a QAM 
signal has been transmitted. In one embodiment, the re- 
ceiver uses a hybrid cost function that is the superposi- 
tion of a QAM-based cost function and a CAP-based 



cost function. In another embodiment, the receiver com- 
prises an adaptive filter that alternates between a QAM- 
based cost function and a CAP-based cost function. In 
addition, a method is described that uses information 
about (a) the expected constellations, and (b) the values 
before and after a rotator of the receiver for deciding 
what type of signal is being received. 
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Description 

Cross-Reference to Related Applications 

5 [0001] Related subject matter is disclosed in the co-pending, commonly assigned, U.S. Patent application of Werner 
et aL, entitled "Blind Start-Up Of A Dual Mode CAP-QAM Receiver," serial No. XXX, filed on even date herewith. 

Field of the invention 

10 [0002] The present invention relates to communications equipment, and, more particularly, to the use of blind equal- 
ization in a receiver. 

Background of the Invention 

IS [0003] Carrierless amplitude modulation/phase modulation (CAP) is a bandwidth-efficient two-dimensional passband 
line code. (Additional information on a CAP communications system can be found in J. J. Werner, "Tutorial on Carri- 
erless AM/PM - Part I - Fundamentals and Digital CAP Transmitter," Contribution to ANSI X3T9.5 TP/PMD Working 
Group, Minneapolis, June 23, 1992.) CAP is closely related to the more familiar quadrature amplitude modulation 
(QAM) transmission scheme. In voiceband modems, QAM has been used for over 25 years, while CAP has been used 

20 for over 15 years. However, CAP is simpler to Implement digitally. Illustrative prior art transceiver structures for the 
QAM and CAP transmission schemes are shown in FIGs. 1 and 2, respectively. Both FIGs. 1 and 2 illustrate two- 
dimensional encoding where a complex symbol. /A^, is applied to the transmitter portion (where A^ = 3^^+ jb^), and a 
recovered complex symbol. is provided by the receiver portion, where A^ = a^ + jb^ With respect to other notation 
used in these FIGs., g(t) (e.g., see FIG. 1) is the impulse response of a baseband shaping filter, Ojjt) and e^Jt) are 

25 equalizers for the in-phase and quadrature components, respectively, and p(t) an6P'(t) are impulse responses of a 
passband shaping filter which form a Hilbert pair (e.g., see FIG. 2). 

[0004] To observe the difference between QAM and CAP transceivers, notice in FIG. 1 that the conventional QAM 
transmitter consists of a baseband pulse shaping filter followed by a modulator. The idealized QAM receiver for the 
case of no intersymbol interference (I SI) and additive Gaussian noise inverts these operations first using a demodulator 

30 and then a matched filter. An equivalent representation of the QAM transceiver is shown in FIG. 3, where the filtering 
and modulation operations have been reversed. This is known as the passband representation because the filtering 
is done at passband. To compensate for ISI, the matched filter has been replaced by an equalizer. Finally, removing 
the modulator and demodulator in FIG. 3 yields the CAP transceiver of FIG. 2. which attains the same theoretical 
performance as QAM but is simpler to implement digitally. 

35 [0005] Currently, some broadband access applications, such as VDSL (Very high rate Digital Subscriber Line), may 
require either a CAP receiver or a QAM receiver Some in the art have proposed simply putting both the CAP receiver 
and the QAM receiver into one receiver - in effect having a dual structure receiver with a CAP section (having its own 
equalizer) and a separate QAM section (with its own equalizer). To further complicate matters, this dual structure 
receiver may require the use of blind equalization techniques in both the QAM section and the CAP section. In this 

40 case., there is no training signal for the dual structure receiver to use to identify the type of modulation. As such, the 
dual structure receiver must first independently converge both the equalizer in the QAM section and the equalizer in 
the CAP section, and then make a decision as to the type of modulation before switching to the correct steady state 
operating mode. 

[0006] An alternative approach is described in the above-referenced U.S. Patent application of Werner et al., entitled 
45 "Blind Start-Up Of A Dual Mode CAP-QAM Receiver." In this approach, a receiver utilizes a single equalizer for sup- 
porting both a CAP mode of operation and a QAM mode of operation. 

Summary of the Invention 

so [0007] The receiver structure described in the above-referenced U.S. Patent application of Werner et al., entitled 
"Blind Start-Up Of A Dual Mode CAP-QAM Receiver" may require the use of an additional constellation phase com- 
pensator for correct decoding of a QAM signal. However, I have realized that this receiver structure can be further 
improved to eliminate the additional phase compensator In particular, and in accordance with the invention, a dual- 
mode receiver uses a hybrid cost function that provides for automatic constellation phase recovery regardless of wheth- 
55 er a'CAP signal or a QAM signal has been transmitted. 

~[XX)08] In an embadmrentoftKe invention, a receiver comprises an adaptive filter that utilizes a combined cost function 
during blind start-up. This combinedjcost function is the superposition of a cost function based on one type of received 
'"sig'narre.g-. QAM, with a cost function based on another type of received signal, e.g., CAP. 
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[0009] In another enribodiment of the invention, a receiver comprises an adaptive filter that alternates between a cost 
function based on one type of received signal, e.g., QAM, and a cost function based on another type of received signal, 
e.g.. CAP. 

[0010] In accordance with a feature of the invention, a method is described that uses information about (a) the ex- 
s pected constellations, and (b) the values before and after a rotator of the receiver for deciding what type of signal is 
being received. 

Brief Description of the Drawing 
w [0011] 

FIG. 1 is a block diagram of a prior art baseband QAM transceiver; 
FIG. 2 is a block diagram of a prior art GAP transceiver; 
FIG. 3 is a block diagram of a prior art passband QAM transceiver; 
'5 FIG- 4 is an illustrative block diagram of a portion of a communications system embodying the principles of the 

invention; 

FIG. 5 shows an illustrative block diagram of a cross-coupled equalizer. 
FIG. 6 is an illustrative block diagram of a phase-splitting equalizer; 

FIG. 7 is an illustrative block diagram of a portion of an adaptive filter for use in an equalizer; 
20 FIG 8 shows illustrative decision-directed structures tor receiving a CAP signal and a QAM signal; 

FIG. 9 shows a summary of three blind equalization approaches; 

FIG. 10 shows illustrative updating structures for a CAP equalizer and a QAM equalizer; 
FIGS 11-13 illustrate CAP-based reception of a QAM signal in certain situations; 

FIG. 14 is an illustrative block diagram of a portion of a receiver embodying the principles of the invention; 
^5 FIG. 15 illustrates the operation of a hybrid cost function in accordance with the principles of the invention; 

FIG. 16 shows a block diagram illustrating tap updating of an equalizer structure in accordance with the inventive 

concept; 

FIG. 17 shows an illustrative flow diagram of a method in accordance with the principles of the invention; 
FIG. 18 shows another embodiment in accordance with the inventive concept; 
30 FIG. 19 shows an illustrative blind start-up procedure in accordance with the principles of the invention; and 

FIGs. 20 and 21 are illustrative block diagrams of a portion of a receiver embodying the principles of the invention. 

Detailed Description 

35 [0012] An illustrative high-level block diagram of a portbn of a communications system embodying the principles of 
the invention is shown in FIG. 4. For illustrative purposes only, it is assumed that receiver 10 receives either a CAP 
signal or a QAM signal. It is assumed that the CAP or QAM signal has been distorted while propagating through 
communications channel 9 and experiences intersymbol interference (ISI). The purpose of receiver 10 is to remove 
the ISI and minimize the effect of any additive noise ^(t)\o provide signal r'(t). The inventive concept will illustratively 

40 be described in the context of a receiver that (a) has a dual mode of operation (a CAP mode and a QAM mode), and 
(b) only uses a single equalizer for both the CAP mode of operation and the QAM mode of operation. 
[0013] However, before describing the inventive concept, some background information on adaptive filters is pre- 
sented. Also, as used herein, an adaptive filter is, e.g., a fractionally spaced linear equalizer, which is hereafter simply 
referred to as an FSLE or. simply, an equalizer. Further, the term "single equalizer structure" encompasses an adaptive 

45 filter for equalizing a received signal. As known in the art, this equalizer structure, or adaptive filter, itself may comprise 
other filters for different components, or combinations, of the received signal. For example, a "single equalizer structure" 
Is a traditional complex equalizer (also known as the cross-coupled equalizer) shown in FIG. 5, which comprises four 
filters; or a phase-splitting equalizer shown in FIG. 6, which comprises two filters, etc. 

50 Adaptive Filters and Decision-Directed EQuaiization 

[0014] An illustrative phase-splitting FSLE equalizer 100 for the reception of a CAP signal is shown in FIG. 6. It is 
assumed that FSLE equalizer 100 operates on an input signal that can be characterized as having A/ dimensions. In 
this example, /V= 2, i.e., the input signal comprises two component dimensions: an in-phase component and a quad- 
55 rature component. FSLE equalizer 100 comprises two parallel digital adaptive filters implemented as finite impulse 
response (FIR) filters 110 and 120. Some illustrative details of the equalizer structure are shown in FIG. 7. The two 
FIR filters 110 and 120 share the same tapped delay line 115, which stores sequences of successive Analog-to-Digital 
Converter (A/D) 125 samples rf^ The sampling rate l/T'oi A/D 125 is typically three to four times higher than the symbol 
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rate l/T and is chosen in such a way that it satisfies the sampling theorem for real signals. It is assumed that 77T = i, 
where / is an integer. 

[0015] The outputs of the two adaptive FIR filters 110 and 120 as shown in FIG. 7 are computed at the symbol rate 
l/T. The equalizer taps and input samples can be represented by a corresponding N-dimensional vector. As such, the 
following relationships are now defined: 

r^^ = [ff. , r^_^ , ] - vector of A/D samples in delay line; (1) 

c^^ = [Cq , , S — , ] = vector of in-phase tap coefficients; and (2) 

d^^ = [d^ , , d2 I o^/s/ ] = vector of quadrature phase tap coefficients; (3) 

where the superscript T denotes vector transpose, the subscript n refers to the symbol period nTand k= (i)(n). 
[0016] For the CAP-based phase-splitting equalizer, let y^ and K be the computed outputs of the in-phase and 
quadrature filters, respectively, and: 

/n^^n^^niand (4) 

v; = dj r.. (5) 



[001 7^ An XA^ display of the outputs y'^ and K or, equivalently, of the complex output y„ = V„+J . 's called a signal 
constellation. After convergence, ideally the signal constellation consists of a display of the complex symbols = a„ 
+ corrupted by some small noise and tSI. 

[0018] Referring back to FIG. 6, FSLE equalizer 100 for the reception of a CAP signal can be characterized as having 
^0 two modes of operation, a decision-directed mode (steady state) and a start-up mode (non-steady state). In the deci- 
sion-directed mode of operation, the decision devices, i.e., slicers 1 30 and 1 35, compare the equalizer complex output 
samples. Y'^, with all the possible transmitted complex symbols. A^, and select the symbol A^ which is the closest to 
Y'^. The receiver then computes an error, E^, where: 



^; = <+y^;= n' - (6) 



which is used to update the tap coefficients of equalizer 100. The most common tap updating algorithm is the 
LMS algorithm, which is a stochastic gradient algorithm that minimizes the mean square error (MSE), which is defined 

as: 



MSE(V:) A E[\E:'C]-E[\y: - Aj'] = E[e':-]^E[e:']. (7) 
In equation (7). £[•] denotes expectation and and K are the following in-phase and quadrature errors: 
so e„=y„-a„, and (8) 

= (9) 



[0019] For the CAP line code^ the tap coefficients of the two adaptive filters of the phase-splitting equalizer are 
updated using the above-mentioned least-mean-square (LMS) algorithm, i.e., 
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^n.7 = ^n-«^nfn'a"d (10) 



5 dnH = <ln-a <r„, (11) 

where a is the step size used in the tap adjustment algorithm. 
[0020] A higher level representation of a decision-directed equalizer for CAP signals is shown in FIG. 8. As also 
10 shown in FIG. 8. for a QAM signal the decision -directed equalizer includes a complex rotator (65) between the adaptive 
filters and the slicer. The error E„=Y„- is modulated back to passband by rotator (60) before being used to update 
the fitter coefficients. For a QAM signal, the filters of a phase splitting equalizer are updated using the LMS algorithm 
as follows: 
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20 



25 



30 



SS 



= c„ - a K^\(J„ - A„ )e'""^"^]r^ ^^^^ 
= c„-aRe(n;-^;)rJ 



= d„ -alm[(y„ - ^„)e^'"^''^]rj ^^^^ 
= d„-alm(y„'-^;)rj" 

where y^= V^e/^c"^, A '^= Af^ef^cnT g^id Re( ) and lm( ) denote the real and imaginary parts, respectively. 
Blind Equalization and Constellation Phase Recovery 



[0021] In contrast to the steady state mode of operation, the start-up mode is used to converge the lap coefficient 
values to an initial set of values. In some systems a training sequence (i.e., a predefined sequence of symbols) Is 
used dunng start-up, from which the receiver can compute meaningful errors E„ by using the equalizer output signal 
Y„ and the known sequence of transmitted symbols A„. In this case, tap adaptation is said to be done with respect to 
3S an "ideal reference." 

[0022] However, when no training sequence is available, equalizer 100 has to be converged blindly First, a blind 
equalization algorithm is used to open the "eye diagram." Then, once the eye is open enough, the receiver switches 
to. e.g.. the above-described LMS tap adaptation algorithm. The philosophy of blind equalization Is to use a tap adap- 
tation algorithm that minimizes a cost function that is better suited to provide initial convergence of equalizer 100 than 

^0 the MSE represented by equation (7). 

[0023] Although there are a number of blind equalization techniques known in the art, only three general approaches 
are discussed herein. One is referred to herein as the "reduced constellation algorithm" (RCA) (e.g., see Y. Sato, "A 
Method of Self-Recovering Equalization for Multilevel Amplitude-Modulation Systems," IEEE Trans. Commun.. pp 679 
- 682. June 1975; and U.S. Patent No. 4,227,152, issued October 7, 1980 to Godard); another technique is the so- 

^5 called "constant modulus algorithm" (CMA) (e.g.. see D. N. Godard, "Self-Recovering Equalization and Carrier Tracking 
in Two-Dimensional Data Communications Systems, " IEEE Trans, Commun., vol. 28, no. 11., pp. 1867-1875, Nov. 
1960: and N. K. Jablon, "Joint Blind Equalization, Carrier Recovery, and Timing Recovery for High-Order QAM Signal 
Constellations", IEEE Trans. Signal Processing, \/o\. 40, no. 6, pp. 1383-1398, 1992); and the final technique is referred 
to as Ihe "mullimodulus algorithm" (MMA) (e.g., see Yang, J. and Werner, J. J., The Multimodulus Blind Equalization 

^0 Algorithms, Proceedings of DSP97, Santorini, Greece, 1997). 

[0024] FIG. 9 shows a graphical representation of the cost functions from which CMA, MMA, and RCA are derived. 
As shown in FIG. 9a, CMA attempts to fit a square signal constellation to a circle. The corresponding cost function is 



CFcMA(^n)=^{(|^/-«^f}. (14) 

where L is most often chosen to be 2. For L = 2 this cost function is invariant to a phase rotation because IV^a^l^ 
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= \ YJ^. Thus, an additional constellation phase compensator is required to properly align a square equalizer output 
constellation to the X and Y axes before sending outputs into the slicer. 

[0025] MM A and RCA, on the other hand, are not invariant to a constellation phase rotation. Minimizing their respec- 
tive cost function will lead to proper alignment (modulo 90"") of a square equalizer output constellation with the X and 
5 Y axes. Thus, an additional phase compensator is not required. As shown in FIG. 9b, MMA tries to fit a square signal 
constellation to a square contour with cost function 



10 



IS 



where L is most often chosen to be 2. Similarly, as shown in FIG. 9c. RCA attempts to fit the constellation to a 
reduced set of four points at the vertices of a square with cost function 

CFrca ( Yn) = E{\ Yn - S9"( V„f }. (16) 



with c sgn(y„) = sgn(y„) + /sgn( j^^ ). where sgn ( ) is the signum function. 
[0026] As further background, the LMS update equations tor MMA and RCA are provided below As an example, the 

20 update equations for the phase splitting FSLE implemented for CAP and QAM signals using the traditional structures 
is shown in FIG. 10. For MMA (L=2), the filter coefficient update equations for a CAP signal attempting to minimize 



2S 



^c„-a(y^R')y„rI (17) 



d„+i = d„-a(3?;2 -/?2)>^;rJ. (18) 
30 [0027] The analogous equations tor a QAM signal trying to minimize CF^^,^^ ( y„) are: 



(19) 



35 



^[0„ - ^ )yn s\n(cu^nT) ^(y^ -R^ cos(tyc«r)]rJ , (20) 



40 [0028] For RCA, the filter coefficient update equations for a CAP signal attempting to minimize CFRCA(^n) 

c„,i=c„-a[y;,-Rsgn(y>; (21) 



45 



= d„ - a[y;, - R sgn(^; )]r J . (22) 



[0029] The analogous equations for a QAM signal trying to minimize CF^q^ ( Y„) are: 

so 



55 



= <^n -^sgn(>',J)sin((2;^;/n+(J?„ -/?sgn(J;„))cos(^^^^ (24) 
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Mismatched CAP-Based Reception of a QAM Sional 

[0030] In the above-mentioned U.S. patent application of Werner at al.. entitled "Blind Start-up of a Dual Mode CAP- 
OAM Receiver," it is demonstrated that a single equalizer-based CAP receiver can be used to decode a QAM signal. 
This scenario is shown in FIG. 11 . Without a rotator in the CAP receiver, if the QAM symbols are selected from a square 
consiellation, the outputs of the equalizer, upon convergence, will belong to concentric circles as shown in FIG. 11 for 
w.o different values of f^T Thus, if a blind algorithm such as CMA, MMA or RCA is used to converge the equalizer 
: !.><. It will be operating on circular symbol constellations as shown in FIG. 12 (as opposed to square ones as shown 
r riG 9). Even though MMA and RCA can successfully open the eye in this case, due to the invarlance of circular 
. M\ cllalions to phase rotation about the origin (this is approximate for the discrete case), both algorithms lose their 
f v.'cllation phase recovery properties. Consider as an example the reception of a QAM signal using the apparatus 
; ■ cioscd in the above-mentioned patent application of Werner et al.. which is shown in FIG. 13. If the equalizer is 
V -'H. 01 god by applying MMA to the equalizer outputs, the eye is successfully opened. However, the act of fitting a 
i>:.\j. I c lo a circle makes it unlikely that the QAM symbol constellation will be correctly oriented after rotator (70). 

/ > /. i/ Mode CAP -QAM Receiver 

(003 1 ] I have designed a single equalizer-based receiver that is capable of opening the "eye" for both CAP and QAM 
siqf^^.is and lhat has the additional property of yielding the correct constellation orientation before or after the rotator 
tti pntiiculHc. and in accordance with the invention, a dual-mode receiver uses a hybrid cost function that provides for 
^uiutrirthc phase recovery. This hybrid cost function is also referred to herein as a "dual-mode cost function." In ac- 
cordance wilh the inventive concept, the basic method for forming the dual-mode cost function is to combine the single- 
mDdc CAP and QAM cost functions on either side of the rotator in a receiver The hybrid cost function takes advantage 
of iho constellation phase recovery properties of blind algorithms such as MMA and RCA and is used in conjunction 
with square symbol constellations (described below). In addition, this receiver automatically detects which modulation 
method IS being used and switches to the appropriate decision-directed structure (described below). 
[0032] In accordance with the inventive concept, a portion 150 of a dual-mode receiver for CAP and QAM, such as 
receiver 10 of FIG. 4, (also referred to herein as a CAP-QAM receiver) is shown in FIG. 14. Other than the inventive 
conr.op! the elements shown in FIG. 14 are well-known and will not be described in detail. Receiver portion 150 com- 
prises equalizer 155. rotator 165 and dual-mode algorithm element 160. The latter updates the tap coefficient values 
(not shown) of equalizer 155 as a function of the signal on either side of rotator 165 (described further below). The 
double lines are representative of a complex signal. 

[0033] As used herein, CF^^^ denotes a blind cost function matched to a CAP signal and processing the equalizer 
outputs Y'^ before the rotator. For example, the CAP-based RCA cost function is: 

CFrca = CFrcaC Yn) = E{| Y„ - Rc sgn( Y„)\\ (25) 

[0034] Similarly. Cf^^*^ represents a blind cost function matched to a QAM signal and processing the rotator outputs 
y„ For example, the QAM-based MMA cost function is: 

CfSJX =CFmma(J;)=£((I>'J^-^^)^ +(|>?J^-/J^)2}.(26) 

[0035] FIG. 1 5 demonstrates the effect of minimizing CF^^p and CF^am concurrently for the case of MMA in accord- 
ance with the invention. If a CAP signal is sent, the "eye" is opened by minimizing both CFj^jJ,^ and CF^*^. Minimizing 
CF^jJ,^ corresponds to fitting the square constellation to a square contour, correctly aligning the CAP constellation 
( with the X and Y axes before the rotator. On the other hand, minimizing CF^"^ corresponds to fitting concentric 
circles of points to a square contour, making the cost function approximately independent of constellation phase ori- 
enlalion. FIG. 15 also shows that ihe reverse happens for a QAM signal, leading to an open "eye" and correct con- 
stellation oiientation aftei the lolalor (of Y^). Once the equalizer has converged, the type of modulation can be deter- 
mined (as explained below) and the receiver switches to decision-directed mode. Two illustrative methods of minimizing 
QpcAP and CF^^ are described herein: a superposition method and an alternation method (It should be noted that 
although two illustrative methods are described, the inventive concept is not so limited.) 



so 
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Superposition Method 

[0036] The superposition method consists of minimizing the sum of the single mode CAP- and QAM-based cost 
functions. In this context, the dual mode hybrid cost function is represented by: 

[0037] The components of the hybrid cost function can be mixed and matched so that, for example, one possible 
hybrid cost function is: 

[0038] A stochastic gradient type algorithm can be used to minimize CF^'^ . 

[0039] For example, for a hybrid cost function of CF^*^ - ^'^mma ^^mma ' phase-splitting FSLE taps are updated 
using: 

20 2 2 7. 1 

- iyn - Wn smicOcnr)]r^ (29) 



25 



30 



40 
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SS 



+ (Pn - -R^ )P« cos(6)c»n]rJ (30) 



[0040] These update equations are essentially the superposition of equations (17) and (18) with (19) and (20). In 
accordance with the inventive concept, a portion 200 of a dual mode receiver for CAP and QAM, such as receiver 10 
of FIG. 4, (also referred to herein as a CAP-QAM receiver) is shown in FIG. 16. This block diagram illustrates the 
embodiment of the superposition method in the context of using the MMA algorithm and assuming the use of square 
constellations. Other than the inventive concept, the elements shown in FIG. 16 are well-known and will not be described 
in detail. CAP-QAM receiver portion 200 comprises equalizer 205. rotator 210, filter updating elements 215 and 220. 
and adder 225. For the purposes of this description, it is assumed that equalizer 205 is a single phase-splitting FSLE. 
but the inventive concept is not so limited. 

[0041] As noted above, other hybrid cost functions can be formed. For example, CF"^^ = CF^^^ + CF^^|^ with the 
equalizer being updated using: 

-iyn-R sgnCv„ )) sin(a)^wr)]r J (3 1 ) 



+ (J« - R sgn(r;, )) cos(r^c«r)]r;f ^ (32) 

which are formed by combining equations (21) and (22) with (23) and (24). The proper choice of R in these 
equations is discussed bebw. 

[0042] It should be noted that the error components of the coefficient update equations for this superposition method 
require almost twice as many additions and multiplications as those for the separate CAP and QAM equalizers. If the 
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processor is incapable of performing these additional operations at the symbol rate, two possible solutions exist. Either 
the tap coefficients of the equalizer can be updates at a rate sbwer than the symbol rate or the following alternating 
method can be used. (Unfortunately, both solutions come at the price of a slower equalizer convergence rate.) 

Alternation Method 

[0043] The alternation method is formed by alternating back and forth between minimizing CF^^^ and CfOAhA yve 
can represent this dual mode cost function as 

CF°"(I) = CF'^'''' ^ CF°"(II) = CF°*". (33) 



where I and II represent alternating time intervals of duration at least as long as the symbol period T. Like the 
above-described superposition method, the single mode CAP-and QAM-based blind cost functions can be mixed and 

matched. 

[0044] Using a stochastic gradient algorithm, if Cf^^{\) = CF^^p cfdm(||) = CF^^, the phase-splitting FSLE 
taps are updated alternatively using equations (21) and (22) followed by equations (23) and (24). Similarly if CFD'^(I) 
= CFJ^jJj^ and CF'^'^(II) = CF^'JJ. the equalizer taps are updated alternatively using equations (17) and (18) followed 
by equations (19) and (20). 

[0045] An example of the alternation method is shown in FIG. 1 7 for MM A. In this illustrative method the single mode 
cost functions are alternated on a symbol-by-symbol basis. For example, in step 905, of FIG. 17, a first symbol is 
received. In step 910, the single mode CAP update equations (17) and (18) are executed. For the next symbol, received 
in step 915, the single mode QAM update equations (19) and (20) are executed in step 920. For the following symbols, 
the process repeats as shown in FIG. 17. This alternating approach is illustrated in the context of receiver portion 200 
as shown in FIG. 18. 

[0046] It should be noted that this alternating method converges at half the rate of the superposition method. Anal- 
ogous superposition and alternating methods can be formulated for the cross-coupled equalizer of FIG. 5, using the 
corresponding update equations Other variations of the alternating method are possible as well. For example, the 
equalizer can execute the single mode CAP update equations (17) and (18) /ctimes for each execution of the single 
mode QAM update equations (1 9) and (20). This would be particularly applicable in a multipoint to multipoint network 
where there are /ctimes as many CAP transmitters as QAM transmitters. Similarly, the converse is possible, i.e., exe- 
cuting the single mode QAM update equations /r times for each execution of the CAP update equations. 

Calculation of Constant R 

35 

[0047] As noted above, and in accordance with the principles of the invention, the value of the constant R (e.g., see 
equations (29) and (30)) is a function of the type of blind equalization algorithms used to form the hybrid cost function. 
Below, illustrative values for Rare given for dual mode MMA and RCA blind equalization algorithms. These values of 
flcan be used both in the superposition and alternation methods. 

40 

R for Dual Mode MMA 

[0048] As described above, and in accordance with the inventive concept, a hybrid cost function of a dual-mode 
receiver using both a QAM-based MMA cost function and a CAP-based MMA cost function resulted in tap update 
equations (29) and (30) for the superposition method. For these equations it can be shown that the best steady-state 
R^ is equal to; 



so 



(34) 



where we define: 

55 



A^=§^+ and 



9 



BNSDOCID: <EP ^0969640A2_L> 



EP 0 969 640 A2 



A=Ae 



jbi nT 



[0049] Equation (34) assumes that the channel is perfectly inverted by the equalizer, yielding A^, and that the 
symbol streams [a„} and [b^ are independent identically distributed and mutually independent. 
(0050] For Z. = 2, it can be shown that: 



7E{a: I + 3£* (a; ) Ela^ ] - 3E' {a^„ ] 



(35) 



8£{a;} 8£{a;} 
[005 1 ) It can be shown that equation (35) can be further simplrfied by using an average of over time, which yields: 



(36) 



[0052] Computer simulations have shown that this constant produces a similar convergence rate and "eye" open- 
ing riojiity as fl^. For a square constellation, equation (36) can be further simplified to: 



/=?^ = ^(52/77^-27). 



(37) 



where m is the number of symbolj^vels. 
30 [0053] Illustrative average values for as a function of m are shown in Table One, below. 

Table One 



35 



40 



m 


Constellation Size 




1 


4 points 


1.25 


2 


16 points 


9.05 


4 


64 points 


40.25 


8 


256 points 


165.05 


16 


10244 points 


664.25 



R for Dual Mode RCA 

J5 [0054] For dual mode RCA using tap update equations (31 ) and (32) for the superposition method, it can be shown 
that: 



so 



li. = 



^-'{i'^nl - l^J} E{\a„ cos(eo^nr) - b„ sin(£y,«/)| + \a„\] 



(38) 



[0055] This is optimal for both CAP and QAM signals. Due to the non linearity of the absolute value, the denom- 
55 inator cannot be expressed directly in terms of the moments of a^. For the square constellation, it can be shown that: 
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R. = 



H4m- -1) 



m m 



(39) 



"'^±^11 Y.pk - \)cosico^nD-i2I-\)sin{co,nr)\ 



10 



15 



20 



[0056] If were plotted for m = 2 and m = 8, (which respectively correspond to 16- and 256-point constellations), 
it would be observed that oscillates with time. As such, an ad hoc simplification of averaging R„ over n is used, 
which is denoted herein as ^. Illustrative average values for R as a function of mare shown in Table Two, below. 

Table Two 



m 


Constellation Size 


R 


1 


4 points 


1.055 


2 


16 points 


2.560 


4 


64 points 


5.334 


8 


256 points 


10.772 


16 


10244 points 


21.596 
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[0057] Simulations have shown that this function, Ti, produces convergence properties similar to R„. 
Modulation Type Determination 

[0058] As described, several dual-mode blind equalization algorithms were described. A blind start-up procedure in 
accordance with the principles of the invention for use in receiver 10 of FIG. 4 is shown in FIG. 19. In step 580, receiver 
1 0 uses GAP-QAM hybrid blind equalization with its corresponding tap updating algorithms to begin blind convergence 
of an equalizer. In step 585, a decision is made whether to switch from GAP-QAM hybrid blind equalization to the 
decision-directed mode or to continue using GAP-QAM hybrid blind equalization to converge the equalizer. Typically, 
this is referred to in the art as determining if the eye is open enough (as noted above) Step 585 of the blind start-up 
procedure can be schedule-driven, event-driven, or both and is described further below. With a schedule-driven ap- 
proach, the switch between two different tap updating algorithms occurs after some fixed number, K, ot iterations (which 
can be determined by a counter, for example). This approach presumes a certain amount of eye-opening after K 
iterations. With an event-driven approach, the switch occurs when a certain quality of eye opening is achieved. This 
can be done, for example, by continuously monitoring the MSE and making the switch when the MSE is below some 
threshold S. If the eye has been opened enough, receiver 10 switches to the decision-directed mode in step 590. (It 
should be noted that the focus of the inventive concept is the use of a single equalizer during blind start-up. As such, 
once the transition to the decision-directed mode occurs, further updates occur as known in the art. For example, in 
the QAM mode of operation, an additional rotator may have to be used when updating the equalizer using LMS. Illus- 
trative decision-directed structures are shown in FIG. 8, where CFqq is the decision-directed cost function. ) 
[0059] In order to switch into the decision-directed mode in step 585, and in accordance with the inventive concept, 
it must be determined whether the received signal is a GAP signal or a QAM signal. For illustrative purposes, an MSE- 
based method, an MMA-based method, and an RGA-based method, are described further below. It should be noted 
that the MMA-based method and the RGA-based method use information about (a) the expected constellations, and 
(b) the values before and after the rotator. The equations shown in these sections can be used for any combination of 
combined cost function. For example, they are not limited to just using the superposition method cost function CF^^^ 
-h CF^^. they can also be used for CF^^ + CF^^, ^^m^ + ^^ca • ' These techniques can similarly be used 
for the alternation technique and its associated cost functions. 

MSB-Based Method 



55 



[0060] One way to decide whether a GAP signal or a QAM signal is being received is to compare estimates of the 
MSE based upon to that of the MSE based upon V^. If a GAP line code is being transmitted, in steady state the 
equalizer yields: 
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(40) 



5 

with the inequality reversed for a QAM line code. Here, quantities A'^ and correspond to sliced versions of 
and Y^. As the MSE will not be known exactly, running sample averages: 



10 



1 "i •'^ 



MSE CP = - Y^iy'r. - + - . and 



(41) 



75 



20 



MSE 



(42) 



can be used to estimate MSEq^p and MSEq^. As noted above, to decide when to make the transition from 
blind start-up to decision -directed mode, two methods can be used: 

1) Event-Driven Approach: Decide whether a CAP signal or a QAM signal has been sent when the MSE or 
2S MSE QAM^ respectively, first falls below an experimentally determined threshold. 

2 ) Schedule-Driven Approach: At time rij -t- A, decide that a CAP signal or a QAM signal has been received 
depending on whether MSE^^p or MSE q^/^ is smaller. The decision time, is chosen experimentally such that 
the blind dual-mode algorithm has achieved steady-state operation. 

30 [0061] These two approaches can be written in decision-rule form as: 



35 



^THRESHOID 
' MSE 



QAM sent MSE q am 

if < r first. 



(43) 



CAPsGtix MSE CAP 



40 



45 



^ MSE 



QAM sent 



if MSE CAP MSE QAKi at « = //^ . (44) 

C4Psent < 



so 



[0062] In practice, a hybrid of the two approaches could also be used, making a comparison ot MSE^^pOt MSEq^/^ 
at a particular time, if the threshold has not been passed by either quantity. Alternative decision statistics can also be 
derived from the dual-mode cost functions, potentially leading to computational savings, as follows. 

MM A 'Based Method 



55 



[0063] This illustrative method assumes a square symbol constellation with the MM A cost function. In addition, it is 
assumed that the channel is perfectly inverted by the equalizer, and that the symbol streams {a„} and {b^} are inde- 
pendent identically distributed and mutually independent. The following test is used: 
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'MSE 



QAM sent 



if C/^MMA CFmma 3Xn = n^ . (45) 



C4Psent 



where CFj^^and CF^^ are estimated using the sample averages: 



10 



CF"^ . 1 (l^^l^ - ^^)^ ^(U;„f - /?'-)\ and (46) 



75 
20 

[0064] The fixed threshold approach can also be used to form ^J^^a^^^^ analogous to equation (43). 
[0065] For L = 2. an alternative, simpler, decision rule is: 

QAM sent < 

if TCrIZ^ TCR"^ at /I = . (48) 
OiPsent > 

30 

Where estimates of the tricor relations are 



25 



<^,TIME 



[0066] The samples estimates of equations (49) and (50) require half as many multiplies as those in equations (46) 
45 and (47). 

RCA'Based Method 

[0067] The constellation phase recovery property of the RCA cost function is used to form the following test: 

50 



OAM sent 



^ RCA ~~ 



55 



if Cr RCA 



Orca at/j = /7. 



(51) 



C4Psent 
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where CF^^^ and CF^^^ are estimated using the sample averages: 



CFIZ ^ ^ - Rs^iy'jf -Rs^(y:)y . and (52) 



CFi^ - I i: (:^n - ^ sgnO^. ))' (7. - ^ sgnCy„ ))' . (53) 

[0068] Again, an analogous threshold-based test 5^^^^^^^^^ can be constructed. 
75 [0069] For a perfectly equalized channel, a simpler decision rule is: 



20 Orca 



OAM sent 



-CAP ^ ^^ QAM 



if ^^5 RCA ^55 RCA at = . (54) 

C4Psent > 



where estimates of the expected absolute values are: 



ABSnc. - { i:iy;| + U^;|, and (55) 



[0070] Illustrative embodiments of the Inventive concept are shown in FlGs. 20 and 21 for use in receiver 10 of FIG. 
4. FIG. 20 illustrates an embodiment representative of a digital signal processor 700 that is programmed to implement 
an FSLE in accordance with the principles of the invention. Digital signal processor 700 comprises a central processing 
unit (processor) 705 and memory 710. A portion of memory 710 is used to store program instructions that, when 

40 executed by processor 705, implement CAP-QAM hybrid blind equalization (described above). This portion of memory 
is shown as 71 1 . Another portion of memory, 71 2, is used to store tap coefficient values that are updated by processor 
705 in accordance with the inventive concept. It is assumed that a received signal 704 is applied to processor 705, 
which equalizes this signal in accordance with the inventive concept to provide a output signal 705, e.g., using the 
superposition method or the alternating method, or variations thereof For the purposes of example only, It is assumed 

45 that output signal 706 represents a sequence of output samples of an equalizer (As known in the art, a digital signal 
processor may, additionally, further process received signal 704 before deriving output signal 706.) An illustrative soft- 
ware program is not described herein since^ after learning of the CAP-QAM hybrid blind equalization as described 
herein, such a program is within the capability of one skilled in the art. Also, it should be noted that any equalizer 
structures, such as a cross-coupled equalizer, can be implemented by digital signal processor 700 in accordance with 

so the inventive concept. 

[0071] FIG. 21 Illustrates another alternative embodiment of the inventive concept. Circuitry 600 comprises a centra! 
processing unit (processor) 605, and an equalizer 61 0. The latter is illustratively assumed to be a phase-splitting FSLE 
as described above. It is assumed that equalizer 610 Includes at least one tap -coefficient register for storing values 
for corresponding tap coefficient vectors (e.g., as shown in FIG. 7). Processor 605 Includes memory, not shown, similar 
55 to memory 710 of FIG. 20 for implementing CAP-QAM hybrid blind equalization. Equalizer output signal 611, which 
represents a sequence of equalizer output samples, is applied to processor 605. The latter analyzes equalizer output 
signal 61 1 . in accordance with the inventive concept, to adapt values of the tap coefficients in such a way as to converge 
to a correct solution, e.g., using the superposition method or the alternating method, or variations thereof. 
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[0072] The foregoing merely illustrates the principles of the invention and it will thus be appreciated that those skilled 
in the art will be able to devise numerous alternative arrangements which, although not explicitly described herein, 
embody the principles of the invention and are within its spirit and scope. For example, although the inventive concept 
was Illustrated herein as being Implemented with discrete functional building blocks, e.g., equalizer 610, etc., the func- 
tions of any one or more of those building blocks can be carried out using one or more appropriately programmed 
processors or processing circuitry, e.g.. a digital signal processor, discrete circuit elements; integrated circuits; etc. In 
addition, although the Inventive concept was described in the context of a single phase-splitting equalizer, other forms 
of equalizers can also be used. 

Claims 



. Apparatus for use in receiving a carrierless amplitude modulation/phase modulation (CAP) signal or a quadrature 
amplitude phase modulation (QAM) signal, characterized by 

a receiver that has a dual mode of operation, a CAP mode and a QAM mode, that utilizes only a single equalizer 
for both the CAP mode of operation and the QAM mode of operation wherein tap coefficients of the equalizer 
are updated based upon a hybrid cost function. 

20 2. A method for use in a receiver for blindly equalizing a received signal, the method comprising the steps of: 

using an equalizer for blindly equalizing the received signal for providing an equalized signal; and 
updating associated tap coefficients of the equalizer as a function of a hybrid cost function. 

2S 3. Apparatus of claim 1 , or the method of claim 2, wherein the hybrid cost function provides for automatic phase 
recovery. 

4. Apparatus of claim 1 , wherein the hybrid cost function either comprises at least two components, one component 
representing a cost function based upon the CAP signal and the other component representing a cost function 

30 based upon the QAM signal, or is any combination of either a constant modulus type of algorithm, a reduced 

constellation type of algorithm, or a multimodulus type of algorithm as applied to the CAP signal and the QAM signal. 

5. The method of claim 2, wherein the hybrid cost function either comprises n components, each component repre- 
senting a cost function based upon a different type of transmission scheme, where n > 1 , or is any combination of 

55 either a constant modulus type of algorithm, a reduced constellation type of algorithm, or a multimodulus type of 

algorithm as applied to the different types of transmission schemes. 

6. Apparatus of claim 3, or the method of claim 5, wherein one component of the hybrid cost function is used to 
update values of the tap coefficients more frequently than another component of the hybrid cost function. 

40 

7. The method of claim 5, wherein one transmission scheme is a carrierless amplitude modulation/phase modulation 
(CAP) and another transmission scheme is a quadrature amplitude modulation (QAM). 

8. The method of claim 5, wherein the hybrid cost function either comprises two components, one component rep- 
45 resenting a cost function based upon a carrierless amplitude modulation/phase modulation (CAP) transmission 

scheme and the other component representing a cost function based upon a quadrature amplitude modulation 
(QAM) transmission scheme, and/or is any combination of either a constant modulus type of algorithm, a reduced 
constellation type of algorithm, or a multimodulus type of algorithm as applied to the CAP transmission scheme 
and the QAM transmission scheme, 

so 

9. The method of claim 8, wherein the QAM related component of the hybrid cost function is used to update values 
of the tap coefficients more frequently than the CAP related component of the hybrid cost function. 

10. The method of claim 8, wherein the CAP related component of the hybrid cost function is used to update values 
ss of the tap coefficients more frequently than the QAM related component of the hybrid cost function. 

11. The method of claim 2. wherein the received signal represents any one of a number of transmission schemes, the 
method further comprising the steps of: 
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performing lor each type of transmission scheme a mean square error type of calculation for providing a re- 
spective number; and 

deciding what type ol transmission scheme the received signal represents by comparing the respective num- 
bers for each transmission scheme, and optionally the step of switching to using a decision-directed mode for 
5 updating the associated tap coefficient values after a predetermined amount of time. 

12. The method of claim 2, wherein the received signal represents any one of a number of transmission schemes, the 
method further comprising the steps of: 

10 performing for each type of transmission scheme a cost function type of calculation for providing a respective 

number; and 

deciding what type of transmission scheme the received signal represents by comparing the respective num- 
bers for each transmission scheme, and optionally the step of switching to using a decision-directed mode for 
updating the associated tap coefficient values after a predetermined amount of time. 

75 

1 3. The method of claim 1 1 , or 1 2, wherein the deciding step includes the step of switching to using a decision-directed 
mode for updating the associated tap coefficient values. 

20 
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FIG, 15 
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FIG. 1 8 
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